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ABSTRACT 



The Human Resource Managetnent CpuVse Monographs provide descr ipt ions, of 
traming courses for ^graduate students anti nllnpower practitioners, including 
treatment of. some of the major functions of manpower programs. ^Manpower Pro- 
ject Monitoring and Program Evaluation is designed to introduce the student 
to the' principfes, techn iques and l\im"i tat ions of t^e mon i tor i ng and eyalua- 
tion prpcess. The^co'urse also provides the students with "hands-on'* experience 

in designing a model "nxanpQwer monitoring and evaluation system for 'a particu-' 

/ . J 

.lar'organization. Monitoring essentially involves the--d^termi^.t ion of whether 

• / « 

or. not ^''project i^ doing what it'said it was going to do. Evaluation involves 



the analysis of the effectiveness of-'a particular project or^ program compojie(|t 
in achievi-ng its s'tated objectives, ^ ^ ^ 
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PREFAfE • • 

As Director of the Human Reiewfces Institute (HRlT in the School of. 
Management of tfie State Un i vers iTy "of New York at Buffalo (SUNYAB) , it is 
. a pleasure for me to annbunce the inauguration of the Human Resource Course 
Monograph Series. The Human Resource?' I nst i tute is an interdisciplinary^ 
teaching ari^ research unit which has been funded under a -grant from the 
.Department o/ Labor jto .estab^Vlshh antf of f er a hunran resources curriculum 
to degree seeking students as well as manpower practitioners employed 
throughout Region II of th?. United States (New York, New Jersey, Puerip 
Rico and the Virgin Islands). \ 

As part of its mandate under the t^anpower Institutional Gra^nt from the? 
Department of Labor, the HRI has developed six new credit bearing human ' 
resources courses and has revised several others. These courses are 
offered during, the evening and are tailored to meet the educat ional needs ( 
of manpov^^r-human resource practitioners as wel 1 as students intending to 
enter the human "resources field.* 

s ■ . ' 

tThe objective of this monograph is to share with other faculty 
• in the human resources development f i el d the 1 earn i ng^object i ves , course 
/structure, instructional strategies, general content and related information 
^ pertinent to specific manpower courses. In^ this, way, instructors of similar 
9r related courses will hopefully benefTt from the experiences derived by 
HRI faci.lty in the formulation and impl ementat ion, of these courses in a non- 
traditional educational environment. , 

* ' * ' • .' 

The initial course monograph, written by two experienced- instructors in 

the human resources field, outlines the components of a manpower" monitoring 
and evaluation curriculum. This ^subject was specifically selected as .part 
of the Institute's course sequence because of the expressed need of admini- 
strators operat ing under^decentral ized special manpower revenue sharing^grants 
to determine the nature and quality of performance of the programs provided 
under their jurisdiction.. Manpower Project Monitoring and Program Evaluation 
was designed, therefore, to teach current and potential manpower staff not 
only how to assess whether part i cu 1 ar programs were meeting their specified 
objectives but also to ascertain th^ cost-effectiveness of the.^program in . 
fulfilling its intended purpose. ' . 1 

I congratulate Myron' Fottl er and Joseph Raelin on- the' product ion of a 
concise, well written monograph arid hope that .its readers will benefit 
from the ideas 'and information they provide in the following pages. 
* . • ■ 

Dr. Thomas G. Gutter^idge ^ 
Di rector 

' ^ . ' Human Resources Institute 



I. INTRODUCTION i 

A. Description of Human Resources Management Curriculum 

The Human Resources Management Optidn is a major component of ^he MBA 
program' at th^ School of Management, State Universitv/ of New York at Buffalo 
(See Figure ij. The School has of fered a' wide rang^ of bourses, over the 
years, encompassing a variety of management subd i sc i pi i nes . 



State University of N6w York at Buffalo 

J'^ School of Management 

: Human Resources Institute 

■ ' » 

Human Resources 
Management 
• Option 



Figure 1 . 

Location of Human Resources Option 
within the SUNYAB System 



Recently,- hov/ever, many faculty members have become increasingly aware that 
the field of human resources management 'and manpower development is'experienc 
Ing a dramatic transformation. Recent course offerings have reflected this 
awareness. On September 1, 197^, ^ 'new elective option in Human Resources 



Management was aSded to the MB?\ curriculum. The>rimary objective of this pro- 
gram is to provide students with a broad management education as well as with 
' the theoretical and practical skills required to assume a career role in the 

appl ie'd human resources f ield. ' — ♦ ^ 

Those students electing the HRM Option generally spend four academic semes- • 
ters ':n residence and, fn addition to the basic MBA core, complete a prescribed 
sequence of four courses in the human resources area (See Appendix C) . While 
not a required part of the program^ HR^l students are encouraged to obtain on- 
sitQ^roject exp^fTence in the manpower-human resource departments of selected 
organizati'ons by me^^s of one semester paid employment traineeships^ credit 
bearing internships.,' or \ndependent study projects. In addition, as part of the 
HRM Option, students must select two human resources management electives an'd 
two general electives. The Manpower Project Monitoring and Program. Evaluation 
course,' (MGI 696), described herein, qualifies as an HRM elective (See Appendix 

A). ' ' 

I . J 

/ ' 

'1- a ' 

. B*. Statement of Course Purpose . ' 

Manpovy^r Project Mon i tor ing >and Program Evaluation provides an introduction 
to the monitoring and evaluation of manpower programs. It is designed to pre- 
pare students not only to monitor and evaluate exi-sting manpower programs, but 
also to develop prototype monitoring and evaluation systems. Students learn ^ 
theorfes, techniques, applications, and limitations of various approaches to 
. ^ monitoring and evaluation. 
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.• ' II. MODEL OF COURSE STRUCTURE 

Course Goals . 

1. To prepare the student to: 

a. Develop an understanding of the origin, development, an'd current status 
. of manpower programs in the U.%S. , including the purposes and achiev^ 

ments of prior categorical manpower programs aS well as the more recent 
CETA legislation. * . V 

b. ' Develop, an understanding of the role. of monitoring and evaluation in the 

total context- of manpower program development . 



c. Develop an understanding of the research framework and various techniques 
of monitoring and evaluation, .including both economic and non-economic 
approiiches . • , , ' • 

d. Design and implement a-. mcJn i^tor i ng and evaluation system for a specific 

organization. 

2. To provide the above applications for both manpower program practitioners 
' ^ and graduate students.^ ^ " *^ 



Course Content 



/ 



1. An Overview- of -^anpov^/er Policy, Past and Present 

2. Federal Manpov;er Programs and Previous Evaluation Efforts 

3. An' I ntroduct ion to Monitoring and Evaluation Research 
A. Project Monitoring ' ' , 

5. Program Evaluatfon 

6. Design of a Model Manpower Project Monitoring and Program Evaluation 
System 



\ ■ ■ . 
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Z. Overview of Instructional Strategies 



^\ 1. During the course^ short lectures and demon st rat ioriis were used by the 

^ " - instructofs to introduce cognitive material. The class discussions of 
the material were based^> "pdPi the readings assigned for the part icular 
week as well as upon the instructors* preservtatTbns. 

2. Three instructors with different experiential and academic backgrounds 
alternated presentation of the material. The diversified perspective 
of the instructors was s.gpp"lemented^by guest speakers (See Appendix E) . 

3. A wide variety of student backgrou^nds contributed to the richness of 

class interactions. Most of the class membership consisted of manpower 

practitioners from city and county governments and from commun i tyrbased 

agencies. In^ addition to manpower practitioners, the class consisted of 
% 

graduate students, including three Ph. D. candidates, and three MBA 

candidates, all from t*he School of Management. ^ ^ 

* 5. A case exercise was given to fhe class in order to provide practice in 

formulating objectives and developing monitoring and evaluation criteria 

(See Appendix D).. ^ 
6. Students were required to subn^it an orig.inal monitoring and evaluation 

design system for their own or^an i zat iop ;( i n the case of pract i t ion^ers) 
' • . or for ajifodel organ i zat i'^on (in the case of graduate students). 

D. Assessment System 

1. An inter im assessment -vyas done halfway through the .semester to determine*' 
student attitudes towar^d the course (See Appendix F) . 
• 2. A final assessment was i compl eted during the last week of-class (See 

Appendix F) . ^^^^^^^^^^^^^^^^ 

o 
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ml oeSCRIPTION OF INStRUCTIQNAL MODULES 

To insure mastery of course content, 'six iiistructional modules were . 

designed, to integrate major topical areas and insure competence attainment. 

The course cons i sted' of 1^ three-hour classroom sessions during the Spring . 

term, 1975/ The modules were delivered as follows: 

' No. of Class 

Module-^No. ^ Title . * * . ' ^ Sessions 

1 '^Overview of Manpower Policy* • . ' 2 

2 , ''Federal Manpov;er Programs'*' 2 

3 "Introduction to Monitoring and EvaVuatmn Research'* 2 
H "Project Monitoring" " 2 
'5 "Program Evaluation" ^ " 3 

.A * "Dtsiqn of Model Monitoring and Evaluation System" 3 

i 

A. Module 1 - "Overview of Manpovjer Policyir' 

Rationale: Th*e purpose of this module >;as to familiarize the student with, 
the development of U. S. manpower policy, the provisions of the Comprehensive ^ 
Employment and' Training Act of 1973 (CETA) , ^nd current issues in comprehensive 
manpower policy. ' , 

Instructional Content: 

1. Reasons for development of categorical federal manpower V^ograms 

2. Previous legislaHpn .and programs 

a) Employment Act of .♦19^6 " , ^ 

b) Ar'^a Redevelopment Act ^ ~ 

c) Manpower Development and draining Act 

f 

f d) Vocational Education Act of 1963 

e) Economic. Opportunity Act and some selected Poverty Programs - Job 
Corps, Neighborhood Youth Corps, J^ew Careers 

f) Cooperative Area Manpower Planning System (CAMPS) 

g) Concentrated Employment Program (CEP) ^ / . 

11 ' ■ : ■ 



"h) Emergency Employment Act of 1971 - * 
3.. Problems with categorical programs 

CETA - description and discussion of all titles 

5. ' Rights and responsibilities of all parties under CETA 

6. Comprehensive manpower policy issues- 

a) potential clients for manpower services ■ ^ 

b) 'potential services . of manpower programs 

c) . interorganizat ional actors involved in manpower del iveVy systems 

d) relationship between^ economic pol i<:y and manpower po-|icy ^ 

e) iss^ues in the debate regarding the utility of macro-manpower policy 

7. Guest Speaker: "CETA and Municipal Employee Labor Unions" 
(Mr. Joseph Rizzo) 

B. Module 2 7 "Federal Manpower Programs" 

' ~ - . % 

Rationale: The purpose of this module was to familiarize the 'student with 

previous evaluation efforts of federal 1 y-sponsored categor ical manpower programs 

Instructional Content: . , 
1 . Eval uat ions of : • 

a) The Manpower -Development and Training Act 

b) Public Employment Progi^am' ' • ^ 

c) Concentrated Employment * Program 

d) Work Incentive Program 

e) Day Care for Welfare Families 

f) Job Bank ' 

g) Project J. E. T. (Jobs, Education, and Training) 

2. Summary - overall evaluation result of categorical programs 



C. Module 3 - V'Introduotion to Monitoring and Eval uiat^ion .Research" 
* ■» 

Rat4onalp: The purpose of this module was to fami l iar ize'?the student with 
the basic principles of the research process and to demonstrate the signifi- 
cance of .evaluation as a vital link in that process. 

s 

Instruct ional Content : . • , ^ 

1. Definition of research - basic, applied and policy 
2- Theory building and hypothesis^-test ing 
3. Principal Ideas undergirding research 

'""a. "Concepts" .7 what are they? ' ^ 

1) Defined as abstractions or perspectives brought to bear on reality 
2:) Types, of concepts • 

3) Concepts in manpower evaluation 

b. Indicators or measures 

c. Indices 

d. Reliability 

e. Val idi ty 

The scienti fic. method and its relevance to evaluation research 
a. ^Dewey's four stages: -.^ 
' ' 1). problem, obstacle, idea 

2) formation of hypothesis (conjectural statement) 
. " ■ ' 3I) reason ingy-deduct ion 

|) observation, .testing, experiment 
b^ Feedback as a fifth stage, creating a loop a la systems theory 
c. Examples of use of scientific method in preparing ffanpower evaluation 

des igns 



5. Definitions of evaluation 

a. Distinction betv/een evaluation and evaluative research 

b. The role of evaluation in the planning process 

6. The six steps of the evaluation process (ref. Suchman) 

a. value formation 

b. goal sett ing 

c. goal measuring (criteria) ^ 
^ d. identifying goal activity (program planning) 

eo putting goal activity intg^operat ion (program operation) 
f. assessing the effect of goal operation (program evaluation) 

7. Guest Speaker: "Current Status of Evaluacion Under CETA" 
(Mr. Charles Atkinson) 

D, Module k - 'Project Monitoring" 

Rationale: The purpose of this module was to provide the student with a 
more in-depth background in project monitoring. 

Instructional Content: 

1. Distinctions between monitoring and evaluation 

^ a. short-run 'vs. long-run 

« « 

b. efficiency vs. effectiveness 

c. process vs. impact . , ' 

2. Kinds of measures used in monitoring and evaluation 

a. input measures 

b. process measures 

c. output measures 

d. benefit measures 



' 1. 
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5. Definitions of evaluation 

a. Distinction between evaluation and evaluative research- 

b. The role of evaluation in the planning process 

6. The six steps of the evaluation process (ref. Sgchman) 

a. value formation 

b. goal setting 

c. goal measuring (criteria) 

d. Identifying goal act ivi ty .(program plann ing) 

ec putting goal actsvity i ntg^operat ion (program operation) 
f. assessing the effect of goal operation (program evalua^t ion) 

7. Guest Speaker: '^Current Status of Evaluation Under CETA** 
(Mr. Charles Atkinson) 

D. Module k - ''Project Mon i t,or i ng'* 

Rationale: The purpose of this module was to provide the student with 
more in-depth background in project monitoring, 

Instructional Content: 
„1, Distinctions between monitoring and evaluation 
^ a. short-run 'vs . long-run 

b. efficiency vs. effectiveness 

c. process vs. impact . * 

2. Kinds of measures used in monitoring and evaluation 

a. input measures * . 

b. process measures - 

c- output measures ^^ 

- - . .... • ^ 

d. benefit measures ^ , • . 



V 



10 

Definitions of monitoring - * - 

a, '^omparison^'of actual accompl i shments wi th planned accomplishments 



b, comparison of actual costs with planned costs 

c, tolerance or variance limits . ^ 
Desk review monitoring ' , 

a, uses 

b, data ava i labl e 
5, On-site monitoring 

a, uses , ^ 

b, management by exception 

c, data generation * v . 

1 ) the interview 

a) description; advantages and disadvantages 

b) methodological issues 

c) types 

1 . structured -standard i zed 
^ " 2. unstructured-unstandard i zed 

2) interview schedules and questionnaires 

a) description; advantages and disadvantages 

b) methodological isstres* 
^ c) types 

1 . f ixed-al ternative i tems 

2. open-end i tet'ms 
3 • sea 1 e i tems 

3) observation 

a) description; advantages and disadvantages 

b) methodological issues 

c) types ' • 
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6. Guest speaker: •'Monitoring and Evaluation Efforts at the State LeveT' 
^ (Mr. Jack Curtin) 



E. Module 5 - "Program /Evaluat ion'^ 
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Rationale: The purpose of 'this module was to provide the student with 
an in-depth knowledge of manpower progra'm evaluation'. 

Instructional Conten't : : * 

1. Reasons for evaluation - personal and organ izatio^Tal 

2. Preparation of an evaluation research design 

a. Components 

1) assessment of needs 

2) identifications of program to meet needs 

3) goals', defined in objective terms; key question - *'Who, v^' 1 1 
do what, when, under what conditions, to what extent, and how 
will it be measured?*' 

^) data collection 

5) analysis; \ .e. statistical techniques 

6) findings 

' 7) recommendations 

b. Types x 

1) one-shot case study ^ '■ " < 

2) one-group, pre-test, post-test design-' 

3) static group coi^^arison ^ 

«r k) pre-test, post-test control group design 

5) Solomon four-group design ^ / 

3. ' Definition of beneficiaries of par^iciilar manpower programs 
k. Setting reali^i^ object i ves . for different beneficiaries-^ 

' ■ ■ ^ IG 
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5. Types of ^?va 1 uat ion methodologies, limitations, and examples 

a. cost-effectiveness analys^is ^ 

b. • relative.ef feet iveness analysis 

c. cost-benefit analysis I 

d. internal rate of return analysis 

6. Evaluation strategies " ' ' ^ 

• *■ • ' . • ^ 

a. process evaluation- 

b. output evaluation 

c. impact evaluation 

7. The political dimensions of evaluation- ' ^ 

8. Case exercise (See Appendix D) 

9. Guest speaker: "Approaches to Manpower Program Evaluation" 
(Mr. Allan Skvirsky) 

F. Module 6 - "Design of a Model Manpower Project Monitoring and Program 
Evaluation Systein" * 

Rationale: The purpose of this module was to provide the student w^ith 
an opportunity to apply classroom applications irt the preparation of- an 

independent project and to practice making an joral preseatatLOn , i nclud i ng 

the assimilation of constructive critiques. 

Instructional Qontent: 
Each student, either individually or as part of o group, developed and pre- 
sented to the rest of the class a design of a monitoring and evaluation system 
for his own organization. In the case of the pract i t ioner the systerrt applied 
to his own organization. In the caSe of the graduate student, a ge^neral model 
.or a design for some -des ignated organization was developed. Among the projects 



completed* were the following:^ ^ . / 

1. "Manpower Monftoring and Evaluation of the Ford Foremen Training 
program'' ' '^I' 

2. ''Manpower. Program Mon i tori ng , and Evaluation System for ^e City'* 
of BuffalV' , ' * 

3. "Monitoring and Evaluation in the Comprehensive Community Counseling 
and Referral Services" 

k. ^"Manpower Planning and Evaluation in a Developing Economy - The Case 
of Nigeria" 

* %> * 

5. ^ "A Model Manpdwer Evaluation System" 

6. "An Evaluation System for the Affirmative Action Program at tfie West- 
Seneca State School" 



A. Evkljuajt ion . 



IV. CONCLUSION • . 

V ■ 

' ^udent perfoHnaa<;4 was evaluated on' the. basis of the monitoring and 

evaluation system developed as well as on class participation. Grades were 

■■■■■■ ^ ■ • * . . 

issued, at the student's option, on ei therv.a "letter" or "satisfactory- 

unsatisfactory'' basis. Students completing unacceptable project? received a 

grade of "incomplete." ♦The course and the instructors were evaluated by means 

of a questio^aire completed during the final week of class (See Appendix F) . 

.■ •. ^. * ■ t 

B . Recommendat ions * * i 

The following recommendations and observations ^are made on the basis of 
the student responses to the course evaluations and a consensus of views 
reached by the Instructors with regard to the workabi 1 i ty of this^pilot format. 



1 A semester-long course may not be the most appropriate format in which to % 
provide manpower prog ram' pract i t ioners with continuing education or training. 
The pressures of the job arrTuch that many practi t roners ar^ simply too ex- 
hausted to participate effectively in a 2 1/2 hour class held imnlediately after 

• . ■ i; • - i 

work. In many cases, these same class members choose not to attend classes 
because of fatigue or, occasionally, because of commitment^o attend evening 
work activities, such as committee meetings. Though the reasons for absences 



:iwcl) 



are most often legitimated, the problem is sufficient to hinder course cont 
ity. 

An alternative format may be to provide modules of selected topics from the 
above curriculum on either a weekend or i ntens ive ^week-long bas^^^f^The Human 
Resources Institute is currently pursuing such an alternative on the basis of 
an educational needs ass^essment, which essentially concurred with the above 
recommendation. " l*vi^ 
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2.^The motivation ofy)rime sponsor practtt ioners to tbke courses in such h^igh- 
ly-technical skills as mon i tori ng^and evaluation must be questioned at the pre- 
sent time on two principal counts. Firs^, at the project Uvel there appears to 
be littTe i.ncentive to conduct sophisticated evaluation analyses* at least at 
this early stage of' state apd local administration of manpower programs. More- 
over, the federal regional of f ice , in its mon i tor i ng^* capac i ty , has not been 
insisting on highly technical aiid qualitative analyses, w|aicb form the subject 
matter of ccjiJrses such as the one described here. Secortdi^^^'t is also apparent, 
at this early stage, that- in some areas political factors compete with ^'scienti- 
fic*' or research indicators in planning and evaluating the objectives of compre- 
hensive* manpower programs. Therefore, in such cases, evaluation efforts may not 
receive sufficient backing from high-level program administrators involved in 
the day-to-day politics of public ^dThi n f strat ion . 

Persistence of either factor cited above can^roduce little i-^centive, 

o 

economic or non-economic, to encourage staff education and training in monitor- 
ing and evaluation. * * 

3. Although mixi^ng degree-seeking students and practitioners in a course such a 
as th^is one may be a desirable strategy, particularly in providing opportunities 
for educational diversification a.nd exchange, -there are some limitatN^ns that 
^ought to be brought to the attention of potential instructors. . As was indicated 

4 

in an earlier recommerf^tion , practitioner attendance will most liHely be infer- 
ior to that of the students. In addition, pract i t ioners^ by virtue of their 
work responsibilities, are more interested in practical appl i cat ions of the currl 
culum, whereas studerti^s' are more willing to consider conceptual material. Final- 
ly, practitioners can^ be expected to devote less time to outside homeworic assign- 
ments tjnan full-time students. These limitations, however, need not thwart-ef- 
forts at "mixing^' asv^long as the instructor is aware of 'them and i s prepared to 
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adjust his teaching strategy to accpmodate the diverse interests without sacri- 
f icing a concern for academic excel lecfge or intellectual integrity- 

a. Where practitioners and students are mixed, team teaching'T^y instructors 

* • • 

* 

with different backgrounds ^academic and practical) appears to bean approprt- 

ate strategy. / . 

/ 

b. Where practitioners and students are mixed, ef/orts should be made to prp- 

•' / • . . 

vide a course location cohven i ent "to both, part l^s. A selection of .a location 

close to a'work site would probably increase practitioner attendance. 



A 



\ 



With an audience sophisticated in^the sense of having knowledge or experi- 
ence in manpower policy. Modules 1 and 2 may be deleted in courses in monitor- 
ing and evaluation, particularly, if the course objectives include solely a'^ 
presentation of essential technical issues. However, such a deletion, risks 
the loss of establishing a conceptual foundation and of integrating the intro- 
ductory knowledge base of the students. 

5. There is considerable confusion in the terminology df monitoring and evalu- 
ation. Students should be made aware of this fact ds early as possible in the 
course and an effort should be made by the instructors to establ i sh common 
def initJonsfor the major concepts utilized in class discussions. It would be 
useful^ in this context, 'for the Manpower Administration's Office of Evaluation 
to provide some standardized definitions for evaluation terminology used in the 
manpower field. ^ 
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MANPOWER PROJECT MONITORING AND 

PROGRAM EVALUATION (MGI 696) 



Spring 

Semester 1975 



Professor Myron D. Fottler 
319 Crosby Hall 
School of Management 
S.U.N.Y. at Buffalo 
Buffalo, New York 1^21^ 



Professor Joseph A. Raelin 
Human l^esources Institute 
School of Management 
S.U.N.Y. at Buffalo 
Buffalo, New York 1^2U 



Professor Edward Cole 
Director , 
Mental Heal th .Manpower and 

Training, Inc. 
260 Elmwood Avenue 
Buffalo, New York 14222 



Class Sessions: Tuesday evenings 5 :00-8 :00 P.M. jjj^ 
Required References: 

(1) nichael E. Uorus and '/illiam R. Tash, Measuring the Impact of flanpower 
Programs : A Primer (Ann Arbor, Michigan: J nst I tute' x?f Labor and Industrial 
Relations, The University of flichigan-'.'ayne S^ate Qhlversity, 1970). 

[U & T] ' ' V ' - ; 

(2) Garth L. flangun and John Waists, A Decade* of ManpQv/^r -Developnent and 

. Trainlng- (Sal t Lake City, Utah: Olympus Pub 1 i sh 1 ng Company , 1973} . . IM & "1 

(3) national League for CitiejB - U.S, Conference of Mayors'; Focus on flanpov/er 
Planning: ilonltoring and /Evaluation .. (S'ashinqton, D. C,, 1973) I'iLFCJ . 

{h) Edward A. Suchnan, [Ivalu|itive Research: Pri nciples and Practice in Public 
Service and Social Action Pronrarns (uev/ York: Russell Sage Foundation, ll)67) 

isj . ^ 

(5) U.S. Department of Labor, flanpov/er Administration, Comprehensive Fnploynent 
♦ and Training Act of 1L^73: Progrom Assessnent Guide ('.'ashinqton; 197^) 

Optional -References: » J 

(1) nicliael L. LJorus, ed. Evaluating the Impact of Manpower Programs (Lexinqton, 
flass.: D. C. Heath and Co., 1972) [BJ 

I 

(2) U.S. President, , j1anciowe& Report of the President (^./ash i ngton , g. C: U.S. 
Government Printing Offf^e, 197^) lilRJ 

Course Objective: To help students des i nn a monitoring and evaluation system 
for their own organization. 

Course Requirement: a model monitoring" arrd evaluation system forceach agency 
represented in the class v/ill be required. Students may submit individual 
or group reports. To tlie extent that time allows these reports wi 1 1 be 
discussed in class. >^ 
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Cole 

COURSE OUTLillH" ' f 

I . An Overvievv of ilanpov/er Policy ( 2 weeks) 

The purpose of this secti.on is to fami 1 i a ri ze the stgdent with the background 
and development of U.S. nanpov/er policy, the objectives of manpower programs, 
and the provisions of the Comprehensive Employment and Training Act of 1973. (CETA) 
*'The Employment and Unemployment Record,** rm, pp, 13-3^>» . (O) 
*^The iJev/ Geography, of Employment: iligration and the American \/orker,** M^, 

pp. -69-102. (0) - " 

"Changing Patterns of Occupational Opportun i ty MR^, pp. 103-130.. 10) 
-iUlanpower -Pro^aws: A ile w Ho le -for States. and Localities,*' 1973 PP. 31-5o. {^)-: 
'Vlanpower Programs: bloving Toward Decent ral i zatiorv," ilRT PP* 37-ow. W 
"Comprehensive Employment and Training Act of 1973**' ^R, PP. 193-2^2. (R) 
Robert Gattman, "Intergovernmental Relations Under the iev* Manpower Act," 

Monthly Labor Review , June 19^73, pp. 10-1 (r) 
"The iiOTA Program in Retrospect," M S \/ , pp. 5-16. (r) ^ 
Michael* J. Piore, "On t4ie Job T ra i n i ng i rv the Dual Labor Market: Public and 

Pri vate-Aesponsibi n ties in on-the-job Training of Disadvantaged \/orkers," 
in Arnold K. Weber,' ed. Public-Private ftanpower Policies (?iadison, l/iscon- 
sin: Industrial Relations Research Association, r.?09) , PP. 101-132. \0) 
Garth L. "ilangum, "ilanpov/er Research and Manpov/er Policy," in Benjamin Aaron, 
^t. al . , editors A Review of Industrial Relations Research, Vol. 11, 
(iiadison, Wisconsin: Industrial Relations Research Association, 1971), 
pp. 61-124. (0) 

Edward '6. Jakubauskas and .leil Palomba, "The Emergence of Manpower Policy," in 
Manpower Economics (heading, .Mass.: A^d i son-\/es 1 ey Publ i sh i ng Co . , 1973), 
pp. 203-224. (R) ' ' 

II. Federal Manpower Programs (2 weeks) . « . 

A. Manpov/er Development and Training Act 

Mangum and \/alsh, pp. 17-144. (R) . 

EInar Hardin and Michael E. Uorus, "Benefits andCosts of MDTA-ARA 
Retraininj," Industrial Relations , May 1972, p. 6. (0) 
' Earl 0. itain, "A ilationwide^Evaluation of MOTA Institutional Job Training," 
Journal of Human Resources Spri ng 1963, pp. 159-170; (O) 

"Report on Education and Tratni'ng Under MDTA ,"^1R, pp. 1$9-l3C. (O) 
• 3. Public Employment Program . 

"keport on the-Public Employment Program, MR, pp*. 145-158. (Rj 
C. Concentrated Em ployment Program 

Morgan V. Lewis and Elchanan Cohn, "Recruiting and Retrai ni ng Par- 
ticipants in a Manpovier Prograr.i,^' Industrial and k.abor Relations , 
Review, January 1973, PP. 842-850. (R) [ t 
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and Cole 

i>- \/ork Incent ive "Provj ran i-ji-iLL (R^ 

i'UlN II; A Progress Report." MR. PP. Hl'I^H. 

\ E. Day Care for Welfare Fanilies . ' , . 

pp. 503-510 (R) 
F. Job bank 

Review . January igy^t, PP- 171-135. W 

. • G . Project J.E.T . . «• . - 

David a. Lipsky.^John-E. Drotning. ^^.^Xt^"^^^^^^^^^^ 

lates of Trainee Success in a Coupled OJT Pi-QJ^t, ^ua^ y 

^ Frnnnmics and Business . Summer 1971. PP- ' nj^easo'ns for 

• , Industrial Relation, May ^^'iM,^,r Trainino Pro- 

' ''7a.s-fo:"HrDlsad;a°Ca;" PH.tl.ns I ndu„ r lei Us ; ' I ndu. t r, al. 
Relations t December, 197^, PP. 685-7O8, (R) ^ 
.1 ...V.H.,..-.nn to Manpower Pro g ra m Monitoring and Evaluation 

(2 weeks) ' • 

^ f=.m;nari7<^ the student with scientific 

The purpose of this section ' = . '° t^"' ' ' ^'^l , ' ioJ a„d the problens 

'A 



occur. ^ 



■^ni°s!^rrhd a^hUi "oj^fu^^ 
f,r„;::e^^j;ncir(Siso::"soins:^,^i^ 

'"^!::!:a^;o°°;rn::o^^r^%oL° "'lndu:;°^:i ua^or,^ 



CVdluoLiwii - 

Review. January 1D72, pp. 235-2'*5. (r) 
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I v. Project flonitoring (1 week) - . ^ 

The purpose of tbis section i.s to provide the student with a nore detailed 

and In-depth background in project monitoring.* 

*i * 

*x . ' 

•'ilonitorlng" in flLFX, pp. 2^-37 and Appendices C and D, pp. 102-116. (r) 

••Establish Progran Objectives," PAG , pp. 11-1 - Jl-^. '(R) 

Myron Roonkin, Sett i ngMferfornance Objectives Under CETA, (Planning and 

Evaluation Conmittee, Governors Advisory Council- on Manpow&r, State 

of Illinois, June 1 97^) , pp"". 1 -3u . (O) 

* 

V. Progran Evaluation (3 weeks) 

The purpose of this section is to provide the student with an in-depth 
knowjedgel^of manpower program evaluation. ^ 

. '•Evaluation,*' in JLFC, pp. 37-^0 and Appendices A, 3, E, F, and G, pp. 91- 

101 and 1 17-162. (R) 
Program Assessment Guide , pp. Ill - V-5. (R) " . ' 

John W. Scanlon, et . al . , »\'\n Evaluation System to Support a Decentralized 

Comprehensive Manpower Progran," in BorOs , pp. 27-33.' (R) 
Articles by Garth, Gryant and Hansen, and Hardin in Borus, pp. 3-12, 

21-25, 59-68.. (0) ^ . . ] 

David H. Greenberg," Employing the Training Program Enroljee: An Analysis 

of Employer Personnel Records," Industrial and Labor^ Relations Review , 

July 1371, pp. 55^-571. (O) ^ 
^ Edward b. Jakubauskas and iieil A. Palonba, "Evaluating Manpower Programs, 

Manpower Economics , pp. 225-2^1. (R) ^ . 

Roonkin, op.ci t /, pp. 3^"51 . (O) * 

VI. Special Problems in Manpower Program Evaluation {1 week) 

The purpose of this section is to provide the student with more depth--and 
detail concerning certain specific problems or issues in evaluation. 

A. Sources of Data . ' „ 

Articles by Fischer, Koenig, Parnes and Shea, Heller and Kelley in 
l3orus, pp. 177-212. (o) . 

i 

Designing Survey Instruments 

Articles by Argana, Sheppard, Barnes, Homans, and Lewis in Borus, 
. .pp. 79-92, W*5-17^K.(0) 

I . . . . 

C. Measuring ilon-Economi c Impacts . 

Articles by.Kasl , .Somers and Stormsdorf /, McDonnell, Mangum and ' 
Robson^ Rosen, and Hamermesh in Borus, pp. 95-1^2, 215-256. (o) 

V I I . Design -of a I'.odel 'Mnnpov/er Program Mon i tor i ng and Evaluation System 
(3 weeks) 

Thes.e sessions will be used to help students to develop a monitoring and 
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evaluation system for their oun organization. Students may work as Individuals ^ 
and In groups and vyill be encouraged to discuss their problems in developing such 
a system with their classmates as well as the instructors. Some time during 
these sessions might also be used to discuss proposal evaluation. A case study 
of one proposal in process could be presented to the class for critical evalua- 
tion. Students will also be encouraged to present their own monitoring and 
evaluation proposals to the class for critical evaluation. 
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' ^ . ADDITIONAL REPEREfJCES 

Bateman, Worth. '"Ah Application of Cost-Ben'efU Analysis to the Work-Experience 
Program." American Economic Review , Vol. 57, May 1967,. PP- 80-90. 

• I'Asses'sing Program Effect i vepess ■ " Welfare in Review , Vol. 6, 
Jan. -Feb. 1968', pp. I-IO. 

Borus, Michae-I E. "A Benefit-Cost Analysis of the Economic Effectiveness of 

Retraining the Unemployed." Yale Economic Essays , VoK 4, 1964, pp. 371-^29. 

Cain, Glen G. and D. Hoi lifter Robinson. "The Methodology of Evaluating Social 
Action Programs." Publ ic-Private Manpower Pol icies . Industrial. Relations 
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1967, pp. 1-11. 
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HUMAN RESOURCES MAfclAGEMENT OPTION CURRICULUM 
^ BUSINESSITRACK MBA ^ 

1st Year 



Fi rst Semester (Fal 1 ) 

• ■ ■■■ I 

MGQ 605 Mathematical .Arta^ys.is for 
Management 

MGS 601 Infroductibn to Computers (1.5) 
M<jA^O^ Finrancia^l Accounting 
MGE 650 Economic Analysis for 

Management" 
MGB 601 Behavioral S Organizational ^ 

Concepts of Management- 1 



Second Semester (Spring) 

MGQ 606, Probabi 1 ity and Statistics 

for Management 
MGI 671 Contempo/ary Human Resources 
' & Industrial Relations Issues 

MGF 625 Financial Management , 
MGy 625 Market rng Management 
MGT 617 Publ ic Pol icy 

MGB 602 Behavioral & Organ izat ional'Con- 
cepts for Ma'nagement 11 (1.5) 



.2nd Year 



Third Semester ^(Fal 1) 

MGS 604 Management Strategy 
"MGI 681 Collective Bargaining 
-MGI 7tJ0 Manpower Pplicy 
ment of Human 

•"^HRM Elective + 
General Elective ++ 



Fourth Semester (Spring) 



\ MGS 605 

Vmgb 650 

S the Develop- / 
Resources -MGI 79^ 



Operations Management 
Organ i zat ion Development 
Skil Is 

Manpower Planning and Adminis- 
tration 
-HRM Elective + 
General Elective ++ 



"These are the courses which comprise the HRM option, i.e., a ^total of six. 

+The two HRM elect ives must be selected from courses offered by the Department of 
Organization and Human Resources or, Jjpon approval of the option di rector ^ an 
appropriate course from another department in the University. 

++lt is expected that the two general electives will be used to enroll in a field 
project such as an internship or to enroll in courses outside the HRM Option. 
Upon request, however, a student^-wi 1 1 be allowed to combine an HRM elective and 
a general elective to complete a six credit internship. Those student's involved 
in an +1RM i n ternsh i p wi 1 1 als/? be required to enroll in MGI 69I (Practicum in 
Human Resources Management) in order to fulfill the internship requirements. 



All courses 3 hours credit unless otherwise noted. 



HUMAN RESOURCES MANAGEMENT OPTION CURRICULUM 
PUBLIC TRACK MBA 



1st Year 



First Semester (Fal 1 ) 

— ^: : [ 

MGa 605 

MG5^601 

MGA eok 

MGE 650 
MGB 601 



Second Semester (SprFng) 



MGQ 606 



MathematJ^l Analysis for 

Managemeh>t . 
.-Introduct ionHo Computers (1.5") MGI 67I 
Financial Accounting 
Economic-Analysis for 

Management 
Behavioral & Organizational 
Concepts of Management 1 



MGf^ 
MGM 
MGE 
MGB 



625 
625 
631 
602 



Probability and Statistics 

for Management . < 

Contemporary Human Resource|?^: . 

& Industr ial Rela t ions f^^^^^^ 
Financial Management 
Marketing Management > . * 
Economics of the Publ fc Sector 
Behgv ioral & Organ 1 za t ional Con- 
cepts for Management 1 1 (1.5) 



2nd Year 



Third Semester (Fall) 

MGT Public Policy Formulation 

*MGI 621 personas4^ Labor Relations 

in ytne FDbl ic Sector 
*MGI 7^80 Man^ov;er Pol icy and the 
Development of Human 
Resources 
'^HRM Elective + / 
General Elective ++ J 



Fourth Semester (Spring) 

MGS Strategic S Operations Management 

in the Pubjic Sector 
"MGB 650 Organization Development 
Skills 

-MGI 79^ Manpower Planning and Adminis- 
tration 
*HRM Elective^ 
General Elective ++ 



*Tfjese are the courses which comprise the HRM Option, J .e. , a total of six. 

+The two HRM electives must be selected from courses offered by the Department of 
Organization and Human Resources or, upon approval of ^the option director, an. 
appropriate course from another' department in the University. 

++lt is expected that the two general electives will be used to enroll in a field 
project such as an internship o£ to enroll in courses outside the HRM Option. 
Upon request-, however, a student wiJl be allowed to combine an HRM elective and 
a general elec£ive to complete a six credit internship. Those students involved 
in. an HRM* internship will also be required to enroll in MGI,691 (Practicum in 
Human ResourcefS Management) in order, to fulfill the internship requirements. 



All courses 3 hours credit unless otherwise noted. 
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CASE STUDY *\<- 

FOR MANPOWER PROJECT MONITORING AND PROGRAM EVALUATION 

The Shady Hill Human Resource Agency is the manpower planning agency 
serving as CETA coordinator for the County of Bounty, a designated prime 
sponsor. Silver Yawn/ the directress of Shady Hill, has appointed Stewart- . 
Dessmel to head up a task force to prepare a monitoring and evaluation 
system to be placed into operation at Shady Hill within the next two months. 
Mr. Dessmel has been given carte blanche by Ms. Yawn to utilize whatever de&\ 
data is available within' the agency and to create whatever additional 
measures may be needed to set up the monitoring and evaluation system. The 
.only constraint specified^s "administrative feasibility. 

•Mr. Dessmel decides to start out by taking a close look at the two major 
training programs 'subcontracted through Shady Hill, the A^B-C Skills Center 
and the N^G-BOF programs. The Skills Center offers primarily -institutional 
traifiing at its training complex, at the corner of Lif e '^nd jftiley Streets. 
Its curriculum is composed of instruction in the traditional occupations- ^ 
such as health sciences, food services, clerical skili^^; mechanics, fconstruc- 
,tion, machine repair, etc. . The NAG-BOP program, on tW^^^ hand, is 

primarily an OJT-type program, operating out of a small ofific^e on the other 
side ^of town. It sendsapplicants to local companies f^»r on-the-job training 
experience. Costs are shared with the compajnies. AlsV, supportive programs 
are conducted at the NAG office, whereas at ABC, these programs are conducted 
^directly at the site at Life and Riley. 

Mr. Dessmel begins reviewing some of the records. He observes that 
disaggreggate data are kept according to such broad categories as sex, age, 
education, race, position in household, size of household, language spoken 
in home, and welfare stacu^. He also begins to pick out other data of inter- 
est. Both programs keep^ l^ecords on pre-program and post-program wages. He 
also notices that each program has follow-up sample sheets, kept at 6-month 
intervals. Furthermore, the follow-up sheets divide earnings gain figures 
into three subr-categories: 

1) * increased labor 'force participation 

2) Higher hourly wages 

3) Improved employment stability 
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Human Resources Institute, School of Management 
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Finally, he also notices that a space is left in each follow-up -sheet for 
separations with accompanying explanation. ■ 

Dessmel decides that both programs lack follow-up informatioft prelative 
to promotions received and training-occupation consistency . (whether jobs are 

in the areas trained) . . 

- Dessmel also decides that both training centers should maintain attitude 
studies. Currently, only the NAG-BOP program has ah attitude survey. Pessmel 
is particularly concerned- that unsuccessful terminees seek work at least more 
after the training experience than before. He is worried^hat such terminees 
may become more discouraged. TiSally, ^e is/also poncerned .aba/Gt the drop- 
out rate in each prefer am" a^nd would like to ?ee such a measure introduced into 
the evaJ-Q^tion design. , . ^ . 

Turning to more operational kinds of data, Dessiiiel checks that both pro- 
grams conduct outreach and assessment. As for facilities, the sKills Center 
at Life and Riley is" relatively run-down, as is evidenced by their high 
maintenance costs. On the other hand, NAG shares its ofrfice space with the 
local Employment Service. 

_Regarding service activities, fessmel knows that -both run educational 
programs. NAG's program is called "employability training" which attempts 
to prej)are applicants for the world of work^id for job search. Teachers 
belong to the ES staff and are paid for their time working with NAG classes. 
The ABC Skills Center ''S educational program is geared more to instruction 
in Bas.c Education, for those who are so assessed, as well as to preparatory 
classes for those interested in taking the (JED. Both' programs provide support- 
ive services - day care, allowances, transportation, medical-dental-legal 
services. Finally, both have active job development components.. NAG here 
again purchases service from the Employment Service. *ABC maintains its own 
staff of Job Developers. ' - 

As Dessmel ^ets up his evaluation design, before going on to some of the 
other programs, "he notes that a comparative study sh«uld be made between 
NAG-BOP and ABC Skills Center. Howevfer, in his notes, he makes mention that 
an-equitable study be conducted. First, he wants to see ABC's costs adjusted 
since their overall costs are now", - at least a« is indicated 'on the books^ over 
2 1/2 times more than NAG's. Also, he wonders whether NAG's location in a • 
predominantly Irish middle-class neighb«rhood ,, as compared to ABC's in the 
Puerto Rican district, will account for demonstrable differences in the over- 
all evaluation. . v " , 
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, You are a staff aid to Stewart Dessmel. You have just picked up your 
assignment for the day. Dessmel has written iti the assignment memo:/ 



1) 



2) 
3) 



4) 



5) 



Write out for me the major objectives you feel should be in 
our ^^ining programs. Try to keep the list to unweighty 
proportions. ' * ^ 

Attach criteria to each objective. i 
Sketch out a few cost-effectiveness or performance rating 
formulas. If you can't get to it, at least provide me. with 
som% rreasonable weights that we can use to evaluate the two 
programs equitably. < ' 

Give me your opinion of which objectives and criteria are, 
at this time, administratively and politically feasible to' 
carry out. 

State your personal views on what other limitations 

we must contend with as we prepare an evaluation and monitor 

ing system. - 



3Y\ 
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GUEST SPEAKERS: 



I . Joseph R I zzo 

President, Local 

American Federation of State , County , and Municipal Employees 
Buffalo, New York 



2. Charles Atkinson 
Region I I Desk Officer 

Office o"f Field Direction and Management 
Manpower Administration 
United States Department of Labor 
Washington, D.C. 

3. • Jack Curti n 

Chief of Manpower Programs 
Manpower Planning Office 
New York State Department of Labor 
Albany, New York 



A1 Ian Skvi rsky 
Director 

Technical Assistance and Training, Inc. 
Washington , D. C. 
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Human Resources Institute 
December 10, 197^ 



MID-SEM23T2R CCUH32 5U23TI0NMR3 

Course; l-Ianpower Project Konltoring and Program Evaluation 
Professors: Cole, ?ottler, Raelin 
Time: Tuesday, 5:30 - 8:00 P.M. 

Direct : ons ; Please answer the following questions as indicated. 

1. Name (optional): 

2. So you plan to take this course for credit? 

3. How many classes have you attended? 

.4.. a. VHien you have attended, what has been your opinion 

of the presentations? (You may cite specific classes, 
if you, wish. ) 



b. In what ways would you recommend that the^jz/urse be 
improved ? 



5. a. If you havp not attended certain classes, please 
give reasoiis for your absence., (You may again 
• cite specif ii:^- instances . ) 



b. Can you suggest anythlnf^ which would: insure more 
regular attendance on your part?' 



6. Any additional comments 



SI L 



! 



10 U\DFC: DSD 



^'ouI'J yon rcco^^^^-^n-i iiv^.tructor to othors? Vpri ]i 

'*ouM vou reco" n J co ^r-^^^ to ot^^'^r'w Yoa T 

derail, you <'elt ch.? in^^tructox* •-a';- '^^icollont 

Overall, you felt tlie cour.^.,^ <^•^.<l: /rcollont *I 

^ar5'H on ln>tructor'i n*^Lli.ty, ''ou ''ould: '^'ronoto T 



:: 'Jo 

X !o 

'I Poor 

IT Poor 

:: Fire 
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4.^ 



^ t #4 



StATE UWlVERSif'Y'Gf NEW YORK AT BUrFALO 



IDENTIFICATiON 

* NUV.BER 



: J DENT 
- USE A, 



thu pi 



p:.-. j* nn nui'lfrf r^^.^m t.^ v^^J by your. m^Jructor jn°thO'^f^ri't;;.rif ftvf: '5^ fc;o>p^")abeie;d 
jiiV. no 'itray rvVks en tru<anf/.ver sheet Erase cc/npibl'-ilv dny answers you . ; 



^{y fdt;nttvy,«n;j lr>fornvit»ti'n you vvHI be a^'<ed to f;ive, Do not write your name. 




Select OH'^ reipoosu for' each iten- tinti record tha^t response by bjackunihg in the appropriaS' space on this sheet. 



EXAMPLE: . 

1. Irt thJsGOwrse'sdepiutment |.tKn^a^^^ ^U\JOR; . j NON-MAJOR; . \,UNDEGlpED 

Th« studf^nt m the.exanip?s ;s a NON -MAJOR in- the department offering the course. ,• • 



R£CP0N^E^2 ■ ■ 'irv^^ sinnu? most accurate answer) ^ . 

- • 'VAiOar ■ .MONMA.IOR; .' UNDEifOEO 



■ 4. ?rl^rr' '-u • 



■:^£;-?VAN- " SOPH' 



3BAD AT ^'ASTER S LEVEL, GBADAT DOCTORAL'LEVEL 



NOT ^EOUIRSD 



VE«V -'AHD 



THE'l^:5^nUCT0R: 



1 J. 



' STl'v^UUT^MG 
HAPO TO VOLLCVV 



VERY LitTLE 

NEVER 



. NOTAr?L;CASLE- 



OEMANQJNG . ^ • 

■B0RIN(3l^ . ' H, / 

POORL^ftEPARED , , 
:SA5V TO FOLLOW 
t;..ACCE3S;eL£ T0STUCE\TS ", 
iSTCLc^A^T O? C^HES POp;TS;C?'= yiEvV 
LAC:xS'€OVMA:>iO.Or 31. ^JtQT ^ , 
;:^:'.:.CQr*^E?ATE TCz/.^-^D STUDENTS ' 

r.S7aR,;^m^;^:i^ Class ' . : ■ ' 



21. ■.. 



;?^E ^ O.-'-^I .iiOAO T'''Q *^^:A'v y : • 

■?:!AC'NG5Tgo«E^£y ■ ' 

■USELESS T0^CV)UR£E' ■ ' , 
Glg^Ail ' ' ' '.^ ^ 

■\<1 CO'*; VE\TS ' 



U^'iFAiR • . 
?'ERE ^;i"".P'C'<:%G 



SD- 



feA 



SO 



~*">ioriTiO..'AU n^' To IE MjLV..D by j^:sTRl>CTOR, DEPAHT:.'HMT. OR FACij^lTY. 
^^^^oulct you reconnand instructor to others? 
^'^ *^ould you reconr*end coiifoe to others? Yes 
- Overall, you felt the instructo '^ras: Excellent; a 
^ Overall,, you felt the cburssMtasr ^ Excellent JT* 
Based on ins tructor'?^ 'ability , you '-rould: _ Promote 2r 



Voov 
^ Poor 
Fire 



er|c 
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